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ABSTRACT 


The  two-dimensional  autoregressive  moving-average  (2-D  ARMA)  models 
have  been  useful  for  image  coding  and  compression,  statistical  image  modeling, 
image  feature  extraction  and  segmentation,  texture  characterization,  and  image 
restoration  and  enhancement.  This  paper  provides  a  critical  review  of  the 
2-D  ARMA  models  for  image  analysis.  Particular  emphasis  is  placed  on  restora¬ 
tion  of  noisy  images  using  2-D  ARMA  models.  Ccnputer  results  are  presented 
for  ccnparative  evaluation  study.  Problem  areas  such  as  order  determination 
are  examined.  Although  there  are  shortcomings  and  unsolved  problems  it  is 
concluded  that  the  models  are  very  effective  linear  models  for  image  analysis. 


I.  Introduction 

The  2-D  ARMA  models  are  now  playing  an  increasingly  important  role 
in  image  analysis  just  as  the  linear  prediction  is  important  in  speech 
signed  processing.  The  primary  advantage  of  the  models  is  the  good  linear 
approximation  to  real  data.  For  one-dimensional  data,  the  models  are  now 
well  developed.  Extension  of  the  one-dimensional  to  two-dimensional  models 
is  not  straightforward  however.  In  fact  much  work  remains  to  be  done  on 
2-D  ARMA  models  for  image  analysis.  For  exanples,  efficient  procedures  to 
determine  the  coefficients  (or  parameters)  of  the  two-dimensional  autoreg¬ 
ressive  (AR) ,  moving  average ,  ARMA  processes  are  much  needed.  The  window 
size  or  the  order  determination  is  another  problem  which  does  not  yet  have 
a  good  solution.  The  models  are  very  suitable  for  homogeneous  random  field. 
For  most  images  in  practical  applications,  certain  objects  are  to  be  extracted 
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from  background.  The  models  are  not  suitable  for  object  boundary  repre¬ 
sentation  .  The  simplicity  of  linear  model  however  outweighs  the  short¬ 
comings  and  problsns  mentioned  above.  The  bibliography  at  the  end  of 
this  paper  provides  a  list  of  references  on  recent  work  in  this  area. 


II.  Applications  of  2-D  ARMA  Models  to  Image  Analysis 


Let  Xrs  be  the  gray  level  of  the  picture  element  at  rth  row  and 
sth  column  of  a  digitized  picture.  For  the  nth  order  autoregressive 
model,  the  picture  elements  up  to  a  distance  of  n  should  be  included 
in  the  model.  The  general  expression  for  non-causal  models  is  given 


by: 


(1) 


n  n 

*rs  ~~  ai^xr-l,s  +  xr+l,s^  +  ^i^xr,s-l  +  xr,s+l^  +  wrs 


where  is  a  zero  mean  input  Gaussian  sequence  with  finite  variance 

which  may  or  may  not  be  knewn.  For  causal  models,  only  past  history 

terms  should  be  included  in  Eq.  (1) .  The  parameters  a^  and  b^  can  be 

estimated  by  using  the  principle  of  minimum  mean  square  error  estimation 

if  the  causal  model  is  considered.  For  the  ARMA  models,  w  should  be 

rr. 

replaced  by  a  set  of  terms  corresponding  to  the  past  input  sequence. 

In  image  coding  and  data  ccnpression  [8,9,11],  the  estimated  para¬ 
meters  values  of  a^  and  b^  along  with  the  initial  conditions  can  be  used 
for  image  transmission.  This  represents  a  very  significant  data  reduction 
over  the  use  of  original  image  data.  Ihe  parameters  and  initial  conditions 
can  be  coded  with  established  coding  schemes.  Good  quality  regenerated 
picture  is  available  frctn  a  second  order  AR  model  for  Guass-Markov  field 
[9], 


In  statistical  image  modeling,  ARMA  models  take  into  account  the 
oontextural  information,  frcm  nearest  neighbors  [1,2,3,5,12,16,21].  In 
the  first  order  AR  model,  for  example,  one  of  the  parameters  is  for  the 
inter-pixel  correlation.  Even  though  the  images  are  rich  in  contextual 
information,  most  dependence  is  frcm  neighboring  pixels  (picture  elements). 
Thus  lew  order  ARMA  models  can  still  be  effective  to  represent  the  image. 

The  limitation  to  the  study  of  causal  or  semi-causal  models  is  a  drawback 
as  each  pixel  should  depend  on  its  neighbors  in  all  directions.  For 
modeling  of  an  object-plus-background  scene,  an  adaptive  procedure  is 
needed  so  that  the  estimated  parameters  will  be  adjusted  near  object 
boundaries. 

In  image  feature  extraction  and  classification,  the  parameters  of  the 
ARMA  models  are  not  very  suitable  as  features  for  image  classification  be¬ 
cause  the  joint  probability  density  of  the  parameters  is  unknown.  A  condi¬ 
tional  probability  density  of  the  gray  levels  of  picture  elements  under 
consideration  can  be  determined  frcm  estimated  parameters  and  the  known 
distribution  of  wrg  [16].  However,  the  number  of  pixels  considered  is 
necessarily  large  and  it  is  not  convenient  to  work  with  a  very  high  dimen¬ 
sional  space.  For  exanple,  a  dimension  of  25  is  large  for  a  small  5x5 
subimage. 

In  image  segmentation,  subimages  of  similar  statistical  characteristics 
tend  to  have  similar  ARMA  models.  The  models  can  be  useful  to  determine 
region  merging  in  the  segmentation  process.  In  model  building  for  pictorial 
textures,  appropriate  ARMA  model  can  be  identified  [20]  by  least  square 
estimation  by  minimizing  the  sum  of  squared  residuals.  For  texture  synthesis, 
a  noise  generator  is  used  to  generate  an  array  of  noise  frcm  which  a  new  array 
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of  data  x^s  is  computed  according  to  the  statistical  model.  The  AFMA 
models  appear  to  be  particularly  suitable  for  pictorial  textures  study 
[7,14,19,20]. 

In  restoration  or  enhancsnent  from  noisy  images,  the  estimated 
parameters  of  the  ARMA  are  useful  to  reconstruct  the  original  image  and 
thus  performing  effective  filtering  operations  [6,10,13,15,17,18].  Sign¬ 
ificant  improvement  in  signal-to-noise  ratio  is  available  even  for  the 
first  order  models  [ 6 ] . 


On  a  2-D  ARMA  Model  for  Noise  Filtering 

The  model  considered  here  is  based  on  that  of  Katayama  [13].  Assure 
a  2-D  homogeneous  image  with  the  autocovariance  function, 

Rxx(i'j)  =  °x2  6X9  t"0! 1 1  f  "  c2  I  j  f Cv  C2  >  0  (2) 

The  image  field  with  this  autocovariance  function  can  be  modeled  by 

x  .  -i  =  a,  x  +  a„  x  -  a,a_  x  +  w  (3) 

r+l,s+l  1  r,s+l  2  r+l,s  1  2  r,s  r,s 

where  w  is  a  Gaussian  white  noise  field  with  zero  mean  and  variance  q. 
r,s 

2  2  2 

a^  =  exp(-C^) ,  a2  =  exp(-C2) ,  q  =  ox  (1^  )  (l-a2  ) 

NOw  consider  the  observable  noisy  image, 


Y  =  X  +  v 
r,s  r,s  r,s 


(r  =  1,2, - ,M;  s  =  1,2, - ,N) 


(4) 


where  v  is  a  Gaussian  white  noise  field  with  mean  zero  and  variance  O'? 
r,s 

The  model  of  (3)  and  (4)  forms  a  state-space  model  for  the  noisy  images. 
For  the  purpose  of  the  parameter  identification,  form  a  2-D  ARMA  model  for 
the  noisy  image, 
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Yrtl,s+1  alYr,s+l  +  a2Yr+l,s  al  a2  Yr,s  +  vr+l,s +1 
+  (K-1}  [alVr,s+l  +  a2  Vl,s  -  al  a2  Vr,s] 


wt iere  K  is  a  stationary  gain,  0  <  a^^,  K  <  1.  Let  8  = 
Define  the  sample  variance  of  v  as 

T/  S 


(a1,  a2,  K). 


,  M  N 

A  <e!  =  J  I 


V 


r=l  s=l 


r,s 


We  identify  the  parameters  a^ ,  a^,  and  K  such  that  A (8)  is  minimized. 
The  method  of  Steepest  Decent  is  used  in  the  optimization  process  which 
is  far  more  efficient  computationally  than  the  optimization  procedure 
employed  in  [ 13 ] . 


Figures  1  &  2  are  two  subimages  (150  x  150)  considered  along  with 
their  histograms.  Figure  3  is  a  noisy  image  corresponding  to  Figure  1 

i*'* 

with  SNR  =  1.73.  Six  iterations  are  performed  in  each  image ^ the  optimi¬ 
zation  process.  Figures  4  &  5  are  the  results  of  filtering  for  different 
initial  conditions.  The  procedure  converges  very  well  for  ary  initial 
conditions .  Figure  6  has  the  SNR  =0.87  with  filtered  result  given  by 
Figure  7.  Figure  8  is  the  noisy  image  corresponding  to  Figure  2  with 
SNR  =  1.73.  Figure  9  is  the  filtered  result.  Figure  10  has  SNR  =  0.87 
with  filtered  result  given  by  Figure  11.  All  filtered  results  accompanied 
by  the  histograms  of  the  filtered  images  clearly  illustrate  that  the  2-D 
ARMA  model  provides  a  very  effective  filtering  procedure  for  the  noisy 
images. 


The  Kalman  filtering  performed  line-by-line  is  much  faster  than  the 


use  of  ARMA  model  while  providing  good  filtered  result.  Figure  12  is  an 
original  image  (300  x  400)  considered  along  with  its  histogram.  Noise 


is  added  to  Figure  12  so  that  the  SNR  «  1.73.  Figure  13  is  the  result  of 
Kalamn  filtering  of  the  noisy  image  performed  horizontally  line-by-line 
[6].  The  filtered  image  is  nearly  identical  to  the  original  image  without 
noise.  Kalman  filtering  of  the  300  x  400  image  requires  only  one-fourth 
of  the  time  required  for  the  model.  It  is  concluded  that  the  Kalman  fil¬ 
tering  is  superior  to  the  ARMA  model  for  restoration  of  noisy  images. 

IV.  The  Order  Determination  Problem 

Although,  the  Akaike  information  criterion  can  be  used  to  determine 

the  window  size  or  model  order  in  horizontal  and  vertical  directions 

separately  [ 5] .  Maximum  likelihood  decision  rule  has  been  suggested  for 

choice  of  neighbors.  For  the  subimage  of  Figure  1,  we  have  employed  the 

procedure  developed  by  Perm  and  Kanefsky  [15]  to  determine  the  order 

accurately.  Hie  idea  is  to  examine  the  determinant  of  the  matrix  of  sample 

correlation  functions  defined  by 

.  M  N 

c  =  _ — L-t- — ,  y  y  x.  .  x.  (5) 

r,s  (M  -  r)  (N  -  s) i=£+1  ^s+1  i,D  i-r,j-s 

where  X.  .  is  an  element  of  the  data  in  a  window  of  size  M  x  N.  Hie  values 
of  M  and  N  are  increased  until  the  determinant  falls  below  certain  specified 
value.  The  largest  M  and  N  values  correspond  to  the  window  sizes  in  hori¬ 
zontal  and  vertical  directions  respectively.  The  result  of  the  computation 
shows  that  the  order  should  be  one  in  each  direction.  Thus  the  ARMA  model 
should  have  an  order  of  2  which  shews  that  the  assumption  of  the  second 
order  model  in  the  previous  section  is  indeed  valid. 

V.  Concluding  Remarks 

In  this  paper  we  have  examined  critically  the  feasiblity  of  2-D  ARMA 


models  for  various  image  analysis  studies.  On  the  whole  the  models  are 


very  effective  though  they  do  not  necessarily  perform  the  best.  More 
research  is  much  needed  on  the  2-D  ARMA  models  so  that  the  models  can 
serve  as  a  general  purpose  image  analysis  tool  which  is  fairly  indepen¬ 
dent  of  the  specific  image  application  under  consideration. 
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